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Adapting the Ilyin Oral Interview 
to a Ksiss Listening Xest 

report by Judy Winn-Bell Olsen and 
Soger E. W.-B. Olsen 

ABSTBiCT 

At this time, there are few readily available tests that 

measure aural structure abilities In lower-level £SL classes In 

adult or high school. Ixx the past two years, howevfer, the 

Ilzln Oral Interview (]ilei\"bury House, 1972,76) has been 

successfully adapted from Its one-to-one format to a mass 

listening test. It Is being used In San Jlanclsco Bay Area adult 

■ 

progirams for achievement testings and has been Used In a 
summer pjJogram for placement purposes, theJaural test 
format Is mnm ^eifl% published, IwiiLAJni , It Is ■ ■ liuuni i j for 
Interested persons to adapt it for themselves from the published 
IlTin Oral Interview . (Ihe publisher has already promised 
permission to duplicate Interview material on written re^iuest*) 
This paper gives detailed Instructions for adapting and 
administering the mass listening test. 
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I 

At this tlme» there are fefW readily available tests 
to measure aural structure abilities In loKer*level SSL classes 
In adult or high schools. Ooliege-level tests such as OELI 
(Harris and Palmer, 1970) and the Michigan Test of English 
Language Proflclencj (Upshur, Palmer, Harris and Hay, 1962} 
do not discriminate the lover levels of language ability—yet 
people at these levels do have importantly different degrees 
of measurable competence* 

Currently, the STEL tests (Best and Ilyin, 1976) and 
EPT tests (Ilyir^, Best, and Biagi, 1971) are available for use 
with loKer^level E3L classes* But these measure knowledge of 
written structure in a multiple-choice format, deujanding only 
passive reading recognition and no production* 

In the past two years, however, experimentation with 
adaptation of a different kind of instrument has produced an 
effective structure test for discrimination of aural abilities 
at lower levels. 

The original instrument, the Ilyin Oral Interview 
(Hewbury House, rev^ ed* 1976) was designed as a one-to->one 
assessment of aurai^oral abilities* An integrative test, it 
centers around pictures of several days in the life of a single 
character. Its scoring system allows partial credit for students 
who understand the <luestion, but cannot give a totally grammatical 
response^ 

Available reliability studies show coefficients ranging 
from .86 to .98. Correlation studies using Bank and Order 
Difference and the Pearson Product Moment show a marked relationship 
between the Interview and other measures of auirai proficiency* 
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There is also a relation .between a candidate's score on the 
intervie-tf and teacher and student opinion of that candidate's 
aural-oral abilities* (llyln, i976* VP* 5$ fi) 

This oral interview has been adapted^ for administration 

I 

Sased on an idea by Hhoda Cui^tis, Berkeley Adult Schools* 

to groups of ESL students in high school or adult school, who 
respond to the examiner's questions in writing* . The storing 
system is the sajie, and, as with the original 1*0 *I* « there are 
two forms, which may be used for placement and achievement 
testing* 

The mass listening forjnat is currently being validated at 
Alemany Community College Center, San Pirancisco, and used to 
measure student progress* In a, 1975 summer program in San 
Francisco for visiting Japanese high school and college students, 
it was used as a placement test, and at the end of the program 
as a post-test to measure gains* In both the adult center program 
and the summer program, teachers concurred with the tests' 
measure of student abilities, and in both programs, a post-test 
did indeed sho'K^ student gains* (See tables I and II*) 

The mass listening adaptation is not currently being 
published, however, and the remainder of this paper will show 
interested teachers, counselors, and other test administrators 
how they may adapt and use the Ilyln Oral Interview as a mass 
listening test* 
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TABLE I 



The AOI (Adapted Oral Interview by Ilyin) was used in 
conjunction Kith the STEL test (Structure Test^p for SSL Leamers» 
Best & Ilyin,. 1975f IJeKbury House) as a pre-program placement 
test and post-program achievement test for a month-long summer 1975 
SSL program for Japanese high school and college students visiting 
San Itanclsco. XKe data from these students 



Is aa follows : 


N 


Mean 


3.D. 


ri 


SEm^ 


Placement AOI 


63 


32.08 


14.43 


.92 


4.02 


Placement STKL 


63 


30.39 


10.96 


.88 


3.80 


Achievement AOI 


61 


42.20 


12.34 






Achievement STED 


60 


34.33 • 


6.62 






AOI Gains 




9.382 


6.19 






STKL Gains 


^1 


3.15^ 


4.49 







Correlation Coefficient and Standard Error of Measurement 
x^ere not calculated for the achievement tests or for the gains 
studies. It was felt that earlier reliability studies covered 
these concerns. (See Ilyln Oral Interview, 1972 & 76, Uewbury House) 

^ ^=11. 4^ 54 df p<(^.005 
^ t= 2.27 50 df : p <^.025 



TABLE II 



A small sampling of students at Alemany Community College Center 
Is reported here to shoK the addltloual promise of the Adapted Oral 
Interview as an achievement (re-placement) test: 



Test 


Class 


H 


Mean — Sept . 


Oct. 


Dec. 




AOI 


Level 300 


7 


30.29 




40.86 




AOI 


Level 200 


28 


• 16.36 




26.57 




AOI 


Level 200 


18 




12.56 


21.55 




AOI 


Level 400 


20 




34.90 


42.30 





Approximately 280 students are currently Involved in a December 1975 
to Ifey 1976 pre/post-test study which will be reported subsequently. 
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IHSTRUOTIOHS FOR ADAPTING THE ILYIH OML IHTERTIEif TO A MSS LISTMIHf? TEST 
PART A 

1. Obtain a copy of the Ilyln Oral Intervlev (ifewtiurjr House, revised 
edition 1976) which includes the interviewer's manual and the two 
complete interview forms with pictures and appropriate q.uestions» 

2* Write for permission from the publisher to duplicate the pictures* 
Permission upon written request has already been promised* 
Send requests to: Rupert Ingram 

Ifewbury House Publishers 
68 Middle Road 
Rowley, Mass* 01969 

3* Photoduplicate the picture-pages from the interview book and 
assemble into boolclets* 

As the interview is actually composed of two separate sets of 
questions and pictures (the "Bill*' form and "Tom" form), it can 
be adapted to*a pre- and post-te'st format* One set of pictures 
is appropriate Monday through Thursday, the other Tuesday through 
Friday, a factor not to be overlooked when deciding which set 
to use. 

4* ffind the appropriate questions in the interview book for your 
particulaj?^ picture series, and decide how many questions you 
want to use* 

There are a total of 50 possible questions for each test, graded 
according to difficulty* For low-level classes, you may want to 
take the first 25 questions only* For somewhat more advanced 
classes, a shortened version of the entire test can be made by 
taking only the spe.cially*iiiarlced items (high discriminators) 
for a 30-item test* 

When you have decided on which questions you will use, number 
them and write them on a separate script sheet for easy use by 
the test administrator (s) * 3S CERTAIN THAT STUDMTS NEVER SEE . 
THE QUESTIOKS IK WHITTEET POEM* - 

5* Make an answer sheet of the appropriate lengthy on which the 

students will write the answers to the oral questions they hear* 
One line is sufficient for each answer* Scoring will be quicker 
if you leave room at the end of each line where the score can 
be circled* (See p*8 for sample answer sheet, used at Alemany 000) 

■r 

6* Be sure that all test administrators have a copy of the test 
questions to be, read aloud, a copy of the Interview Instruction 
Sheet (see next page) and one of the student picture booklets* 
Be sure that they have carefully read all before test-time* 

SOORIHG i 7* In scoring the test, give 2 points for answers with correct 

information and periecx grammar, 

1 point for correct information with 
grammar mistakes (even small ones) ^ and 

0 points for incorrect information 
with perfect or Imperfect grammar* ^ 
If more than one person is scoring the tests> divide the answers 
on each test-sheet so that each scorer corrects the same answers 
on all test papers* While this may result in more paper-shuffling, 
O „ it "ffoes insture that any subjective bias on the part of the 

ER^C scorer will be the same for all student paperfs* a 
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Using the A.OI (Adapted Oral Interview) 

PART B — PRB-TEST ORIENTATION 

1. Read the Ilyin Oral Interview book for details of scoring, 
purpose, and other concerns. 

2. Check to see if using the B-lItL form for Hon, Tues, Wed or Thurs 

or th9 TOM form for Tue, Wed, Thurs, or Pri. 



3^ The materials needed are: 

-Administration instructions (this sheet) 
-Orientation for the test (see following pages) 
-Script for BILL or TOM 

-Examiner's copy of student picture "book (BILL or TOM) 
-Student copie's of picture book (BILL or TOM) 
-Student answer sheets (see enclosed example) 
-Red or blue pen or other highly visible picture-pointer 

4. Arrange seats in well- separated rows, with space for you and 
other proctors to walk behind and between the chairs. Seat 
students in alternate rows like this: . 

X 0 X 0 

not : XOXOXOXOXO net : XX 

X 0 X 0 XOXOXOXOXO 00 

XX 
00 

5. Distribute student answer sheets and picture books. 

6. Instruct students to fill out top of answer sheet. 
While they are doing so, put the following on the bo«rdi 

BOARD EXAMPLES (To teach about writing a short sentence) 



Examples; 1. 

2. 
3.. 

Tell studentsi 

- "Put your picture books face down. Put your pencils down. 

Turn your answe'r sheets over." 

-"I. am going to ask questions. You will- write the answers, 
later I nrlll ask you about pictures in your picture books. 
You will write shoI^t sentences* Not now. Later. This is 
Just an example." (CHEOK TO SEE THAT STUDEKTS ARE NOT WJEiXTING 
AND WILL NOT TOTE THE EUmPLES) - -> 

- "Example #1 on the board. If I ask, *Is this a pencil?* 
(HOLD UP A PENCIL) you will write: 

1. At. /^.. (WBITE ON BLAGKBOAHD) 

3 • r\ 
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Using the AOI (Adapted Oral Interview) 
PART B cont. (Prs-test Orientation) 

- "Do not stop after *yes*." (OOVER UP "IT IS" ON THE BOARD AS 

i . lOU SAY THIS) 

"'Yes' is not a complete se^tence. Al-says write a short complete 
sentence. Do not worry about your spelling. I -will only look 
at the answer and the grammar. 

- (POINT TO #2 ON THE BOARD AND SAYi) "Let's do eiaii5)le 2. 

■ "What's this?" (HOLD UP YOUR PEtTCIL AGAIN. LISTEET TO STUDENTS* 
RESPONSES AND PRETEND TO HEiR "BANANA". WRITS "BANANA" APTER 2. 

1. /t: Li. 

3. 

- ASK: "Is this af good answer? No? Is this?" (CROSS OUT OR BRiSE 
"BANAHA" AND WRITE PSNOJL":) 1. IMjI. ht M» 

3. * 

- ASK: "Is this a good answer? No? Why? 

If you say 'spelling', that is true. The spelling is not 
correct. But for this test, I don't care about spelling. 
Something else is not right. What is it?.. .That's right, 
it's not complete. V/hat should I write?" (HOPEFULLY, YOU'LL 
GET "IT'S A", WRITE IT.) 



3. 

(POINT TO #3 ON THE BOARD AND SAY:) "NOV we will do example 3." 
(RBBiEIffiER THIS IS OITLY BOARD PRACTICE. STUDENTS SHOULD NOT BE 
WRITING OR LOOKING AT THEIR BOOKS OR PAPERS.) 

ASK: "Where are you now?" (LISTEN FOR STODBTTS' RESPONSES, 
BUT WRITE AN INCOMPLETE ANSWER, NO MATTER WHAT THEY SAY) 



3 . f^tJi^L 0Ja ^sLncT>'A^ 

ASK: "is this a good ansiirer? It is correct, but it is not complete* 
V/hat do I write?^ (HOPEFULLY STODMTS WILL INSTRUCT YOU TO WRITE 
•l AM" OR "WE are", you ADD 0TH3R ACCEPTABLE ANSWERS YOU HEAR.' 
EXPLAIN THAT MORE THiN ONE ANSWER MA.Y BE CORRECT. ONLY ONE, • 
HOWEVER, IS NECESSARY. ) 

1. llrAj^, h 

2 . 0 ^/JT/i /V-^ 



ERJC -(WHEN PRB-TEST 0RI3NTATI0N IS FINISHED, GO ON TO SPECIFIC TEST^-. 
QRIEKTATIQN FOR "BILL" OR "TOM" FORM. SEE NEXT PAGE!) 
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TTslag the AOI (Adapted Oral Interview) 

PART 0 ORIENTATION POR "BILL" fOmm * 

- TELL STUDENTS: "Now look at your picture books. Do not write. 
Just listen and look at the first page." 

- "Here are some pictures about a laan. This man is in all of the 
pictures." (POINT TO THE MA.N IN SOME OP THE ^ICS0RS§, USING A RED 
OR BLUE PEN OR OTHER CLEARLY VISI.BLE POINTER. WHEN HOLDING YOUR -* 
BOOKLET K)R THE CLASS TO SEE, BE GARSPUL NOT TO OBSCURE AHY OP THE 
PICTURES T/ITH YOUR HAITO.) 

- "The time is under the pictures. Sometimes you see the beginning 
time and the end time. Sometimes you see only one time. Time 
mov-«s from left to right." (SHOW HOW TIMS GOES PROM A.M. TO P.M. 
WITH TOUR HAND. ) 

-"The pictures in the middle are today, a weekday." (POINT TO THE 
MIDDLE PICTURES.) "What day is today?" (IHE STUDENTS SHOULD TELL 

YOU THE CORRECT DAY) "Right, this is ." (POENT AGAIN 

TO THE MIDDLE PICTURES.) 

-"ihe pictures on the top are last Sunday, a weekend day." (POIHT 
TO THE TOP PICTURES.) "What day was this?" (STUDENTS SHOULD 
TELL YOU THE CORRECT DAY.) "That's right, this was Sunday." 
(POINT AGAIN TO THE TOP PICTURES.) 

-"The pictures on the bottom are tomorrow, a weekday." (POINT TO 
THE BOTTOM PICTURES) "What day will it be?" (STUDENTS REPLY) 
"That's right, this is ." (POINT AGAIN TO THE BOTTOM PICTUR^:^ 

-"Do you have any questions about the pictures?" 

- (check students' understalifding op the above by asking yes-no 
Questions) 

"Is this a weekday?" {POINT TO ilCfTURE IN MIDDLE ROW) 

"Is this a weekday?" (POINT TO PICTURE IN TOP ROW. IP STUDaiTS 

SAY "YES" TO THE LATTER QUESTION, EXPLAIN AGAIN: "This is on a 

Weekend.") 

- (WHEN YOU ARE SURE THE STUDENTS UHDERSTAKD THE PICTURE ARRANGEMENT, 
TELL THE FOLLOWING STORY. POINT TO THE PICTURES AS YOU TALK.) 

--"This man's name is Bill. Bill usually eats breakfast at 7:15« 
'*' He walks to school at 7:4-5. 

— Bill studies from 8:00 to 11:50. He usually eats lunch with 
a friend, but tomorrow he is going to see the doctor. 

— Bill is a student. He studies every day. 

— Last Sunday Bill slept late. He-got up at 9:55. He ate 
breakfast at home at 10:25. 

— Then Bill Went to the beach with a friend. He was there 
from li:00 to 5:00." 

— "Do you have any questions about Bill?" 



**Ihe specific instructions for the "TOM" form of the test (alternate 
of the "bill" form) can be. found by examining the appropriate pages 
O . of the Ilyan Oral Interview. They follow the same general:, format 

ERJC as for "BILL", but the information content is different. 



Using the AOI (Adapted Oral Interview) 
PART 0 3ont. (Orientation for "Bill" "form) 

— "Now I'm going to asfc you about Bill. Take your pencil and 

turn over your answer sheet- I will asfc you three practice questions 
and you will write complete sentence answers. Turn to the ne.z^ 
page in your picture "books." 

— (OHEOK TO SEE THAT STUItJENTS ARE LOOSING AT THE RIGHT PAGE ANH ARE 
READY TO WRITE ON THEIR ANSWER SHEETS. TELL STUDENTS:) 
"Remember, I will say the page number and the number of the 
question. Listen to the question^ look at the picture page^ and 
write your answer on the answer sheet. Hold up 7our hand if 

you do not hear. I will repeat. Look up ^*hen you are finished. 
Then I will give you the next question. Some students are slow, 
and may not finish all questions. If you did not have time to 
answer a question, forget it. Go on. Alvays write the answer 
to the question I asked. Bo not talk or look at oth^r papers." 

— (READ THE PIRST. THREE ITEMS AS PRACTICE QUESTIONS AS YOU 
INSTRUCTED STUD.MTS, SAYING "Next page, eiai!©l6 A." READ THEM, 
MAKING SURE STUDENTS SEE MICH PICTURE TOU ARB POINTING AT. 

YOU MAY WANT TO WALK AROUND THE ROOM AND POINT TO THE PICTURE IN 
THE BOOKS OP STUDSUTS VfflO LOOK CONFUSED. CHECK TO SEE THAT STUDENTS ' 
GIVE A COMPLETE SENTENCE. IP THEY DO NOT, SAY "Write a complete 
sentence." mm THSY PINISH, RSiD EXAMPLE B, ETC. UNTIL YOU HAVE 
FINISHED READING THE THREE PRACTICE ITEMS. 

IMPORTAHTt DO NOT POINT TO A PICTURE UNLESS SO INSTRUCTED . 

(practice ITEl^S) : a. (POINT TO THE PICTURE OP BILL' WATCHING TV) 

IVhat is Bill doing in this picture? 

b. What time is it in the picture? 
(DO NOT POINT TO THE CLOCK) 

c. Who is this man? 

— (APTER YOU HAVE FINISHED ADMINISTERING THE THREE PRACTICE QUESTIONS, 
ASK THEM TO TELL YOU THE ANSWERS. IP MORE THAN ONE ANSWER IS CORRECT 
PUT BOTH OF THEM ON THE BOARD, STRESSING THAT SOME ITEMS CAN BE 
ANSWERED CORRECTLY A NUMBER OP WAYS. BE SURE THEY HAVE COMPLETE 
SENTENCES. THEN SAY:) 

"do you have any questions about the test or about Bill?" 
PART D — GIVING THE TEST 

— (AS YOU READ THE QUESTIONS, GIVE THE QUESTION NUI©ER AND THE 
PICTURE PAGE NUI-I3SR. CONTINUE TO CHECK TO BE SURE THAT THE STUDENTS 

ARE: 1. LOOKING AT THE CORRECT PICTURE PAGE 

2. ANSWERING THE CORRECT ITEM 

3. - TOTING COI^PLETE SENTENCES 

— (READ IN A N0RM4L OONVERSATIOHAL TONE. WHEN REPEATING, MEVER 
STRESS OR EXAGGERATE INTONATION OR PRONUNCIATION. DO NOT OVER- 
MUNCIATE.) 

— (SOME ITEMS 'DEI-IAND THAT STUDENTS GMERATE QUESTIONS RATHER THAN 
GIVE ANSWERS. BE SURE THAT STUDENTS UNDERSTAND THEY ARE TO ASK 

Q QUESTIONS FOR THESE ITEl^S. YOU MAY REPEAT AND EMPHASIZE: ASKTT 

ERJC 19. 



Using the AOI (Adapted Oral Interview) 
PART D. cont. C&ivinp; the Tf?st) 



SAMPL3 Questions, "bill" iorm ~ 3o-itsi€ tbst 

(see also sample page prom the picture booklst ahd sample answer form 
for 30-itsm test used at alekaky center, san mhoisoo. 
not all questions belolf pit the picturb-pags shov/¥.) 

#5 - How does Bill go to school? 

#9 — Is he going to be eating lunch tomorrow at 12:15? 

#16- What was he doing Sunday at 7O0 P.M.? 

#22- (point to bottom ROW PICTURES) 

-These pictures are about tomorrow. What day are they? 

That's right. They're . 

(point to one op the bottom PICTURES) 
' -Ask me a question about this picture. 

#29- Now it's (time) If it were tomorrow at this time, 

what would Bill be doing? 

-(WHEH THE TEST IS COI'iPLETED, BE SURE THAT ILL ANSW3R PORI^IS AND 
PICTURE BOOKLETS ARE COLLECTED BEFORE THE STUDENTS LEAVE. 
CHECK THE BOOKLETS FOR ANY WHITING OR OTHER MARKS.) 

PART E — SCORING .THE TEST 

(see part a, #7 FOR DETAILS.) 
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ANSWER SHEET US^D AT OEKTER 

I.0.l7'AI}AmiI0H Hiss LIStSSriSG 



30 RBKS 



l«*t 



rirat 



Owok tovm 
it 

Tan 



toq>l»*t (p6 or 30) 



BUI 



a 



10 



il2 



16 



18 



32 1*_ 



3. _ 

4. _ 

5. _ 

7._ 

36.. 8._ 

9._ 
10._ 

w.. 

36 15._ 
16.. 

18.. 
19.. 



. 20._ 
M 21.. 

aa._ 

42 23._ 



20 

or 

«fUr 3 

22 



IiO0G6.. 



28.. 



a9._ 

30.. 



Bttlov 20 • nothing 



20-29 
30-39 



300 
400 
S0O/6QO 



Score 
Clrel«t 
2 • 1 - 0 



1 
1 



0 
0 



-1-0 
2-1.0 
2-1-0 

2- 1-0 

3- 1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 
2-1-0 

2-1-0 



ltot«* or GoMuntsi 
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